Stochastic Networks with Multiple Stable Points

This paper analyzes stochastic networks consisting of a set of finite capacity sites where different classes of individuals move according to some routing policy. The associated Markov jump processes are analyzed under a thermodynamic limit regime, that is, when the networks have some symmetry properties and when the number of nodes goes to infinity. An intriguing stability property is proved: under some conditions on the parameters, it is shown that, in the limit, several stable equilibrium points coexist for the empirical distribution. The key ingredient of the proof of this property is a dimension reduction achieved by the introduction of two energy functions and a convenient mapping of their local minima and saddle points. Networks with a unique equilibrium point are also presented.